A Fast Winner-Take-All Neural Networks With the Dynamic Ratio
نویسندگان
چکیده
In this paper, we propose a fast winner-take-all (WTA) neural network. The fast winner-take-all neural network with the dynamic ratio in mutual-inhibition is developed from the general mean-based neural network (GEMNET), which adopts the mean of the active neurons as the threshold of mutual inhibition. Furthermore, the other winner-take-all neural network enhances the convergence speed to become a decimal system. The proposed WTA neural networks statistically achieve the large ratio of mutual inhibition. The new WTA Neural Networks converge faster than the existing WTA neural networks for a large number of competitors based on both theoretical analyses and simulation results.
منابع مشابه
Winner-Take-All Discrete Recurrent Neural Networks
This paper proposes a discrete recurrent neural network model to implement winner-take-all function. This network model has simple organizations and clear dynamic behaviours. The dynamic properties of the proposed winner-take-all networks are studied in detail. Simulation results are given to show network performance. Since the network model is formulated as discrete time systems , it has advan...
متن کاملDistributed ARTMAP: a neural network for fast distributed supervised learning
Distributed coding at the hidden layer of a multi-layer perceptron (MLP) endows the network with memory compression and noise tolerance capabilities. However, an MLP typically requires slow off-line learning to avoid catastrophic forgetting in an open input environment. An adaptive resonance theory (ART) model is designed to guarantee stable memories even with fast on-line learning. However, AR...
متن کاملDynamically-Adaptive Winner-Take-All Networks
Winner-Take-All (WTA) networks. in which inhibitory interconnections are used to determine the most highly-activated of a pool of unilS. are an important part of many neural network models. Unfortunately, convergence of normal WT A networks is extremely sensitive to the magnitudes of their weights, which must be hand-tuned and which generally only provide the right amount of inhibition across a...
متن کاملComplex dynamics in winner-take-all neural nets with slow inhibition
-We consider a layer of excitatory neurons with small asymmetric excitatory connections and strong coupling to a single inhibitory interneuron. I f the inhibition is fast, the network behaves as a winner-take-all network in which one cell fires at the expense of all others. As the inhibition slows down, oscillatory behavior begins. This is followed by a symmetric rotating solution in which neur...
متن کاملSpectra of winner-take-all stochastic neural networks
In Piekniewski & Schreiber (2008) we have developed a simple mathematical model for information flow structure in a class of recurrent neural networks and shown that its asymptotic behaviour is scale-free and admits a description in terms of the so-called winner-take-all dynamics. In the present paper we establish a limit theorem for spectra of the spike-flow graphs induced by the winner-take-a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- J. Inf. Sci. Eng.
دوره 18 شماره
صفحات -
تاریخ انتشار 2002